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ABSTRACT 

Project PROBE in cooperation with the State 
University College at Oneonta implemented a hroad program to upgrade 
the economic liceracy and teaching skills of classroom teachers 
throughout the project region. These activities included offering 
courses for college credit to both elementary and secondary teachers 
in which new ideas and concepts in the teaching of economics would be 
explored. Since it was found that incjividual teachers and entire 
schQOl systems had no planned program for the teaching of economics 
in their social studies classes, a curriciilum guide in economics , 
education for grades kindergarten through- eleven was developed^ The 
1969-7Q, academic year focused on the implementation and evaluarioij of 
those materials. Results indicated that students showed significant 
gains (at an .05 level of sic^nif ica^iceji in critical thiriking skills 
through economic education. , (Author/JB) 
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SUMMARY OF FINDINGS 

The findings of this study need- to be divided into 
two distinct parts. First are those findings dealing with 
changes m the student ^s critical thinking skills. This 
represented the primary thrust of the final year of the 
project, for it was through the evaluation of students 
that^he project could make its best appraisal of the 
experimental curriculum materials that had evolved through 
two previous years of work. 

The project staff is greatly encouraged by the analysis 
of the data collected through pre-testing and pos t:£ites ting 
.the students. To the best of our knowledge and research, 
no. curriculum materials for developing student critical 
thinking skills through economics education has yet been 
developed for public school children. Materials from the 
New York State Education Department, The Joint Council for 
Economics Education, and many commercial publishers focus 
on content and concepts to be learned with little or no 
concern for the thinking or learning processes that are so 
crucial in the long-range development of children as inde- 
pendent learners. Our findings indicate that even within 
the short period of time that children were exposed to the 
project's curriculum materials, gains in student critical 
thinking skills did occur. And in 50% of the null hypoth- 
eses tested / students showed significant gains at least to 
the .05 level of confidence. 

While many variables within the student's learning 
environment could not be adequately controlled by this 
study, i.e., individual teacher skills, teacher-learner 



activities in other subject areas, and the educational 
philosophy of the teachers using the experimental mater- 
ials,.'the ]i' lec:!: staff does feel that its curriculum 
materials are an important contribution to public school 
education. This is particularly important because the 
project's materials provide teachers with' planning and 
implementation models through which improved economic 
literacy and critical thinking skill development can be 
integrated into the larger social studies program, instead 
of isolating or ignoring these key learn rng goals as has 
so often been the case in the past. Obviously, more pro- 
tracted development and evaluation projects in this area 
should produce greater evidence to test the conclusions 
arrived at .by this project. 

The second part of this study dealt with the ways in 
which the activities and cufi-iculum materials of this pro- 
ject acted to alter the attitudes of classroom teachers . 
The project was not attempting to determine if changes in 
teacher attitudes occurred at some statistical level of 
significance, but, whether the project's supportive activ- 
ities for classroom teacher's efforts could, cause changes in 
teacher attitudes that were moving toward greater consis- 
tency with the philosophy and methodology of the "New Social 
Studies" as characterized by the works of Edwin Fenton, 
Hilda Taba, and others. 

In this area^ of research the project found that teach- 
ers, with whom it had worked intensively during the past 
year, showed much greater changes in attitudes than did a 
control group of teachers. The trends in attitudes for the 



experimen u-^ 1 group, although varying in intensity, showed 
changes in an acceptable direction for 75% of the areas 
tested. T}.^ control group of teachers shewed attitude 
changes an an acceptable direction for 42% of the areas^ 
tested. As a result of this study the project staff 
believes that its activities during the past year in sup- 
port of the exper imental teacher group was an important 
factor in bringing about positive changes in teacher atti- 
tudes toward the teacher- learner process. 



STATEMENT OF THE PROBLEM 

Durinq the first two years of this project, the staff, , 
in cocpera^ .on with the State University College at Oneonta, 
and with teachers and administrators in school districts of 
the pro3'e, region implemented a broad program to upgrade the 
economic li-:oracy and teaching skills of classroom teachers 
throughout the project region. These activities, included 
offering courses for college credit to both elementary and 
secondary teachers in which new ideas and concepts in the 
teaching of ecojiomics, would -be explored . In addition, the 
project staff conducted workshops at the, college and on-site 
conf ere.u es and observations with ^teachers in the school dis- 
tricts. As a result of this two-year program, the project 
identified several problem areas that needed treatment if it 
were to improve the economic literacy of the students in our 
public sc hools , 

The first problem identified was that individual teachers 
and entire school systems had no planned program for the teach- 
ing of economics in their social studies classes. The only 
guide <ivailable to them was that provided by the New York State 
Education Department's Curriculum Bureau. Those materials, 
while listing recommended content to be dealt with in the class- 
room, offered no specif ic\^bj ectives or strategies for class- 
room instruction that permitted teachers to define a develop- 
mental or long-range plan. The study of economics was being 
conducted in most of the schools with whom we dealt, but the 
approach was primarily an historical-institutional one with 
little relevance to the larger, more important, learning process 



The lack of knowledge of alternative methods, of instruction 

j 

on the part of the teachers caused both teachers and students 
to become quickly frustrated in the study of economics, and, 
particularly at the elementary level, resulted in a general 
avoidance of the discipline of economics in favor of g-reater 
erafjhasis on the geographic and historical studies. 

A second problem dealt with the nature x>f materials pres- 
ently available. The New York State Syllabus guides and many 
commercially produced materials tended to isolate the study of 
economics from the other disciplines in the social -studies. -Yet 
the teachers below the 12th grade were looking for materials 
that would integrate the study of economics into the larger 
social studies program. 

Finally, the project found that in order for' any program to 
be implemented; teachers needed to feel that they were being sup 
ported and assisted in an on-going effort as opposed to occa- 
sional workshops, conferences, and on-site visits. 

The problem, then, for the third year of this project has 
been to develop a planned program for the teaching of economics 
in grades K-11 that wou^ld relate to the New York. State Syllabus 
Guides, but that would provide more specificity and guidance 
for the teachers daily classroom strategies. The program had 
to be capable of integration' with the larger social studies 
program, although it could at times be historical and institu^ 
tional in approach. It must focus on the significant attributes 
of the learning process that are being reflected in the "New 
Social Studies" projects throughout the nation. The planned 
materials had to be designed in such a way that tjeachers would ' 
find these useful and that desired changes in student learning 
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behavior could be measured. That is, the materials had to have 
a built-in accountability system so that objective evaluation 
could be impl-.^mented in order to provide data for on-going 
revision ana development of classroom activities and ultimately 
the project materials. 

Finally, a system for implementation and experimentation 
had to b^3 devised in which teachers felt a strong commitment to 
the process and that their efforts were-being supported and 
encouraged by a qualified professional staff.. In addition to 
the improvement of economic literacy in the classrooms through- 
out our region, the project was interested in devising systems * 
for dissemination of its materials throughout the state and 
nation, This^ diss.emina tion had to be conducted in such a 
way th I*, others in the f ield^ of economics education would pro- 
vide the project with evaluations of ^the experimental materials^ 



ATTACKING THE PROBLEM 



Having developed a curriculum guide in economics education 
for grades kindergarten through eleven during the summer of 1969, 
the 1969-70 academic year focused on the implementation and 

0 

evaluation of those materials. Working with nine school dis- 
tricts and 12 5 teachers on a voluntary basis , the pro j ect 
depended largely on workshops, conferences, classroom observa- 
tions , and written teacher evaluations to coll upon 
which curriculum revision could be based, during tne summer of 
1970, These curriculum revisions were made during the summer 
of 1970, and a second edition of the curriculum materials entitled 
Economics Education; A Guide For New York Schools , was completed 
prior to the beginning of the 1970-71 academic year* 

It was decided that evaluation of the revised materials 
would focus on two groups: professional educators and students. 
The group of pr of essioi:ial educators was divided into four sub- 
categories • The first group would be no more than 50 classroom 
teachers in the project's immediate region, this group would 
" be involved with the actual implementation of the curriculum 
materials and support for their implementation would be provided 
on a regular basis by the project staff. The second group would 
also be classroom teachers within the project region. They would 
be provided with the curriculum materials from the project, but 
would receive no additional assistance in using the materials 
during the coming year. The third group would be classroom 
teachers from in and outside the project region. The curriculum 
materials would be demonstrated for them in regional meetings, 
but no additional assistance would be provided. The fourth 



-10- 

group would be state and national leaders in the area of eco- 
nomics and social studies education* Materials would be sent 
to them with a cover letter asking for their evaluation of those 
materials. 

The student population to be evaluated was drawn from the 
clas^-'noms of the teachers in the first group. These teachers 
were; re. uited to participate in an experimental course offered 
on a one-year basis by the State University College at Oneonta. 
This— course entitled, Innovations in Teaching Economics/ was a 
graduate level course in which teachers could gain graduate 
college crediit. A description of the procedures and objectives 
of that course are included in Appendix A* In the spring of 
1970, following the approval by the college of the experimental 
course, teachers in selected school districts in our region 
were offered the opportunity to enroll in the experimental 
course in the fall of 1970* Twenty-five elementary teachers in 
Greene Central School^ and nine secondary teachers from Sidney, 
Laurens, and Oneonta Central Schools did enroll in the course* 
Their classroom students became the population for our evaloiation 
of the curriculum materials developed during the summer of 1970. 

The evaluation procedures focused in two directions: First, 
the project evaluated the changes in the critical thinking skills 
of the students exposed to our curriculum materials. In October, 
the project pre-tested students in grades 3-7 using the Taba 
Inference Test developed at San Francisco State College. For 

_ 

In support of the implementation of this project's experimental 
program, Greene Central School, with the assistance of our project 
staff, applied for and received a $7500 ESEA Title II library 
grant in the spring of 1970. These funds were used to establish 
a supplementary edonomics resource center. These materials are 
presently housed at the Greene elementary campus and a catalog 
of the ma ter ial is available on request from that school . 



students in grades 8-10, the project used the Wa tson-Glaser 
Critical Thinking Appraisal Test, Both instruments were used 
to post* test students in April • No test could be found for 
students m grades one and two , and , since no teachers in kinder 
garten or grade eleven enrolled in the experimental course, we 
collected no data on students in grades kindergarten, one, two, 
and eleven • The population tested in grades 3-10 totalled 1031 
students • 

The second evaluation procedure focused on evaluating 

changes in attitudes of professional educators receiving and/or 

using the curriculum materials. The 35 classroom teachers 

involved in the experimental course participated in three 

major workshops in the beginning, middle, and end of the exper- 

imental course. In addition, all teachers met on a regular 

monthly schedule with the course instructor to discuss specific 

implementation problems with the curriculum. This group com- 

2 

pleted a Semantic Differential Inventory at the beginning and 
at the end of the course. 

The second group of classroom teachers were drawn from 
other schools within our region. These teachers all had worked 
with other project materials during the previous school year. 
In October, 1970, each teacher was offered a copy of the curric- 
ulum materials if they would first complete a Semantic Differ- 
ential Inventory which was identical to that administered to 
the first group of teachers. This second group numbered 45 
teachers. A post-Semantic Differential Inventory was sent to 
them for completion in the spring of 1971. 

2 

A copy of this Semantic Differential Inventory is included in 
Appendix B. 
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The third group of classroom teachers were identified 
through the Student Teaching Office at the State University 
College at Oieonta, These teachers acted during the year as 
cooperating teachers for s tudent teachers sent out by ' the 
college. During the year, the project demonstrated the use 
of the curriculum materials for 450 teachers in 15 workshops. 

In April, 112 of these teachers, selected at random, were sent 

3 

questionnaires about their use of the curriculum since 
receiving it during the demonstration workshops. 

The fourth group of professional educators were those 
directors of councils and centers for economics education 
located throughout the state and nation. A copy of the curv- 
riculum materials was mailed to each council and center — 97 
in all. Included was a cover letter asking for their reactions 
to and evaluation of the materials. In April, 1971, a specific 
questionnaire w.is forwarded to a sampling of 60 of these 
councils and centers. 



A copy of this questionnaire is included in Appendix C. 
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ANALYZING THE DATA (EVALUATION) 



A. Hypotheses in terms of objectives: 

1. Tht: implementation of the curriculum materials in class- 
rooms of grades K-11 of the four demonstration schools 
will cause no change in the participating student's crit- 
ical thinking skills. 

2. Classroom teachers, in the four demons tratioh schools 
using the project's curriculum materials throughout one 
school year, 1970-71, will show no change in attitudes 
toward the educational philosophy and methodology pre- 
sented in the curriculum materials. 

3. Participating teachers in the four demonstration schools 
will show no more positive attitudes toward the educa- 
tional philosophy and methodology of the curriculum 
materials than non-participating teachers who received 
the materials in the project region. 

4. Dissemination of the curriculum materials to teachers in 
and outside the project region through demonstration 
workshops will result in a secondary dissemination of 
those materials to other teachers and administrators 
within their schools. 

5. Dissemination of the curriculum materials to individuals 
and agencies in education at the local, state, and 
national level will result in written encouragements to 
continue to develop and revise the materials developed 
by the project. 

6. * The inservice course. Economics 274] Innovations in 

Teaching Economics, conducted in the four dttmon«:tration 
schools to assist teachers in implementing the project's 
curriculum materials, will be judged by the teachers to 
have been of about the same .value as other inservice 
courses in which they have participated. 

7 . Having developed and disseminated the first edition of 
the curriculum materials , the workshops , observations, 
school visitations, and test scores gathered during the 
1969-70 school year will provide sufficient data to 
enable the project staff to revise the curriculum materials 
prior to the 1970-71 school year. 

B. Techniques used to handle the data: 

The 1031 students in grades 3-10 were pre-tested and post- 
tested in October and April, respectively. The student's 
scores were grouped by grade levels and analyzed for signif- 
icant changes in critical thinking skills as follows: 
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Grades 3-7 were administered the Taba Social 
Studies Inference Test (SSIT)^. 

Grades 8-10 were administered the Watson-Glaser 
Critical Thinking Appraisal - YM Porm^ . 

For all these test scores the "t" Test Methodology 
outlined in Appendix D was applied. 
The Semantic Differential Inventory, shown in Appendix B 
was 'the. primary i.nstrument used to gather data relating to 
hypotheses 't-wo , three, and six. Each of the 21 items on -the 
inventory is divided into six rating sub-categories* 

Each category runs a continuum from a very neg,ative atti- 
tude to a very positive attitude. Upon completion of these 
items by a teacher, the project translated the teacher's 
check-marks into number scores using the following number 
des ignat ions : 

Des-rribe: NEW YORK STATE SYLLABUS GUIDES 

Very (,^uite Slightly Slightly Quite Very 

Neutral 



Good 


7 


6 


5 


4 


3 


2 


1 


Bad 


Boring 


1 


2 


3 


4 


5 


6 


7 


Interesting 


Worthless 


1 


2 


3 


4 


5 


6 


7 


Valuable 


Child Centered 


7 


6 


5 


4 


3 


2 


1 


Teacher Centered 


Harmful 


1 


2 


3 


4 


5 


6 


7 


^Beneficial 


Necessary 


7 


6 


5 


4 


3 


2 


1 


JJnnecessary 



Hilda, Taba, Samuel Levine, and Freeman Elzey, Thinking in 
Elementary School Children , Cooperative Research Project No. 
1574 (San Francisco: San Francisco State College, n.d.) pp. 
187-192. (Photocopy from the United States Office of Education. 

Goodwin Watson and Edward M. Glaser, Critical Thinking Appraisal 
New York: Harcourt, Brace & World Inc., 1964. 
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Using this point system, values could be computed for each 
teacher's attitude on each of the 21 items. The most positive 
attitude sccre for each item is 42. The most negative attitude 
score for each item is 6. A score of 24, six check marks in 
the "neutral" jolumn, represents the breaking point between 
positive and negative attitudes. 

In attem];ting to determine the average attitude change 

for teachers referred to in hypotheses two and three, the project 

pre-tested in September, 1970, and post-tested in May, 1971. 

From these tests, 12 items were selected and analyzed. Three 

items, Recalling Facts, Studying the Past, Learning By Listening, 

were deemed to be inconsistent with the philosophy and methodology 

of the project^s curriculum materials. The following nine items 

were deemed to be consistent with the philosophy and methodology 

of the project's curriculum materials. 

Behavioral Objectives 
Planning for Student Learning 
Inquiry Teaching^ 

Project PROBE Economics Education Guide for New York Schools 
Learning By Doing 
Studying the Present 
Problem Solving 

Case Study Approach to Teaching 
Studying the Future 

The point change on each of the 12 items for each teacher 
between the pre-test and post-test was determined and recorded. 
All point changes on each item were then added and divided by 
the number of teachers in each group to determine the average 
point change for the group. The average point change on each 
of the 12 items was then compared between the teachers in group 
one (teachers participating in the experimental inservice course) 
and the teachers ip group two (teachers from the region not 
participating in the experimental course) . This comparison 
would permit the project staff to detect trends — positive or 
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negative — in teacher attitudes and to determine the difference 
in average amount of point change for each group and between 
each group* 

Data for hypothesis six was collected by using two addi- 
tional items from the Semantic Differential Inventory completed 

^the teachers in group one only. The two items used w.ere: 
Inservice Courses and This Economics Inservice Course. By com- 
paring the pre-post scores on these items, the project staff 
could determine changes in teacher attitudes about the exper- 
imental inservice course arid be able to compare teachers' 
attitudes toward that course with attitudes toward other inser- 
vice courses in which these teachers had participated during 
their professional careers. 
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FINDINGS AND CONCLUSIONS 

Social Studies Inference Test (SSIT) (See Appendix E) 
Students in grades three, four, five, six, and seven were 
given the S.S.I.T. as pre and post-test experiences. The 
results of these testing experiences are reported in Table 1 
of this report. 

The S.S.I.T. is designed to measure several aspects of 
the process involved in drawing inferences from data which 
are new to students. The test contains four sub-tests as 
follows : 

1) Inference - the ability to draw inferencos or "to 
go beyond that which is given." 

2) Discrimination - the ability 'tS discriminate between 
the various items given in the test problems. 

3) Caution - the tendency to avoid taking a risk. 

4) Over-Generalization - the tendency toward over- 
inclusion and s tereo typing,. 

To facilitate an analysis of Table 1^ one can proceed 

horizontally in the table to study the various sub«*tests, and 

vertically to study the performances by grade. 

A . Inference 

The fourth, fifth, and sixth grade showed significant gains 
from pre to post-test, each reaching t^ values that cause 
one to reject the null hypothesis at the .01 level of con- 
fidence. The seventh grade's mean change was in the right 
direction, but was not significant. The small sample of ' 
third graders didn't seem to show change, and seemed, 
rather to lose ground in drawing inferences. Actually, 
this is probably more a result of sample size than of 
the effect of the project. 
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Discrimination 

All grades except grade three showed positive change, but 
only the fourth and sixth grade changes were statistically 
significant. Once again, grade three's sample size pre- 
cluded any valid results. It does seem interesting that 
the two other grades showed gains from pre-to-post test. 

Caution 

Project goals would seem to call for a reduction in cauti.on 
scores, and grades five and six showed this trend and 
exhibited significant reductipns. Grades three, four, and 
seven seemed to go toward more caution. Once again, grade 
three went against the expected trend and even gained sig- 
nificance* Grades *f«^r and seven showed gains in caution 
scores, but these could have occurred by chance. The 
fifth and sixth graders seemed to have benefitted most and 
were significantly less cautious. 

Over-Generalization 

As in the caution scores, project goals might be more 
accepting of a reduction in scores in over-generalization. 
All five grades showed this desirable reduction, with 
grades four and five showing significant reductions. 

Analyzing the data by sub-tests, as presented above, 
one might conclude that at least acceptable success was 
attained in all but the sub-test on caution. Here the 
success was mixed, with grades four and seven tending to 
depart from project goals, however slightly. The general 
conclusion* is that the curriculum materials to which 
students were exposed were successful in aiding students 
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to make inferences^ discriminate between items, avoid 
over-generalizations, and had mixed success at reducing 
cautionscores^ 

Third Grade 

As stated earlier, the third grade sample was of such a 
limited nature as to preclude any analysis of the data. 

Fourth ..Grade 

The fourth graders responded both on the plus side of the 
project gocls and on the negative side, too. On the plus 
side were significant gains in inference and discrimina- 
tion, and significant reductions in scores in over- 
generalization. ' Their only disappointment was a gain in 
caution scores when project goals dictated a loss, but 
this change from pre-test mean to post-test mean could 
have occurred by chance . 

Fifth Grade 

This grade gained when it should have and lost when it 
should have also, and all four sub-test t values were sig- 
nificant. In terms of values and project goals# the 
fifth grade was the mos t successful grade taking the 
S.S. I.T. 

Sixth Grade 

All of their changes were in the directions desired, and 
only one score, over-generalization^ failed to reach sig- 
nif icance . 

Seventh Grade 

The direction of change was correct for all but the sub- 
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test on caution, but all four changes failed to reach 
significance. This failure to -attain significance could 
be die to the inability of the S.S.I.T. to discriminate 
at the seventh grade level. Although the S.S.I.T. has 
been used with some success at the seventh grade level^/ 
it was originally designed to be used in grades 3-6 • 

Thus , from a grade-by-grade analysis of S.S.I .T. 
data/ fifth grade emerges as the most successful, fol- 
lowed by sixth, fourth, seventh, and third in that order 

II. The Wa tson-Glaser Critical Thinking Appraisal 

The Watson-Glaser Critical Thinking Appraisal consists of a 
series of test exercises which require the application of 
some of the important abilities involved in critical thinking. 
It contains 100 items that can be completed in about 50 
*ninutes by most persons who have the equivalent of a ninth 
grade education. rt contains five sub-tests as follows: 

1) Inference (twenty items) samples ability to discriminate 
amcng degrees of truth or falsity of inferences drawn 
from given data. 

2) Recognition of Assumptions (sixteen items) samples ability 
to recognize unstated assumptions or pre-supposi tions 
which are taken for granted in given statements or asser- 
tions . 

3) Deduction (twenty-five items) samples ability to reason 
deductively from given statements or premises; to recognize 
the relations of implication between propositions; to deter 
mine whether what may seem to be an implication or a nec- 
essary inference from given premises is indeed such. 

4) Interpretation (twenty-four items) samples ability to weigh 
evidence and to distinguish between: 



Whitehill, William E. , Jr. Evaluation of Thinking In A Seventh 
Grade Social Studies Class . Unpublished' Doctoral Dissertation. 
Washington State University, 1971* 



a) generalizations from given data that are not warranted 
beyond a reasonable doubt, and 

b) generalizations which, although not absolutely certain 
or necessary, do seem to be warranted beyond a reason- 
able doubt* 

5) Evaluation of Arguments (fifteen items) samples ability to 
distinguish between arguments which are strong and rele- 
vant and those which are weak or irrelevant to a partic- 
ular question at issue* 

The Watson-Glaser appraisal was given to grades eight, nine, 

and ten. Project leaders knew in advance that the Watson- 

Glaser appraisal was not normed on eighth graders, but an 

examination of the appraisal disclosed its applicability to 

project goals and seemed to establish a valid reason for ^ 

administering it to the three grades. 

Wa tson-Glaser appraisal results are presented in Table 2. 

Reading the table horizontally gives a picture of the data by 

sub-tests, and vertically by grades. All changes, to meet 

project goals should be positive. 

A . Inf erence 

All three grades showed positive gain, with grades eight 
and ten exhibiting significant gain in inference scores. 
B * Recognition of Assumptions 

All the changes were in the right direction, but none of 
the grades showed a significant change. 

C . Deductions 

Again, all changes were correctly positive, and grades 
eight and ten showed significant gains in scores in deduc- 
tion. 

D. Interpretation 

Tenth grade seemed to benefit most as shown by this sub- 
test, showing a significant gain from pre-to-post mean. 
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The ninth grade showed virtually no change, and the 
eightJi grade showed a significant (P.< .05) loss in inter- 
pretation scores. 
Evaluation of Arguments 

Orce again tenth grade seemed to be the most successful in 
meeting pro j ec t goals , as their mean change attained sig- 
nificance. Ninth grade showed a gain which is desirable, 
but that gain was not statistically significant. Eighth 
grade showed virtually no change from pre-to-post test. 
Total Test 

^11 three grades made gains, with grades eight and ten 
showing changes that were statistically significant. 

In all, a sub-test comparison would seem to indicate 
that the project was successful in all five areas, with a 
slight qualif ication in the area sampled by the sub- test 
on interpretation. 
Eighth Grade 

Eighth graders were successful in exhibiting significant 
changes in inference deductions, and total test scores. 
They showed positive (and desirable) changes in recognition 
of assumptions and evaluation of arguments, but these 
failed to reach significance. They did show a significant 
loss in the sub-test on interpretation. 
Ninth Grade 

An interesting phenomena - five of the six scores were in 
the proper direction, but none of these were significant. 
The ninth graders also showed virtually no change in the 
sub-test of 'interpretation. 



I . Tenth Grade 

In terms of project goals, tenth grade was the most success- 
ful. All of the changes were in the proper direction and 
only the change in recognition of assumptions failed to 
reach significance. 

In summary, eight grades were given pre-tests and post-tests 
to assess change in critical thinking skills. 

One group — Gradies 3, 4, 5, 6, and 7 — were given the 
Social Studies Inference Tests and twenty null hypotheses were 
tested (four sub-tests and five grades). Of these twenty null 
hypotheses, ten were rejected and ten were accepted. The 
direction of change was correct in sixteen of the twenty com- 
parisons. Thus, we must conclude that for the group taking 
the S.S.I.T., there was change and at least half of the change 
was statistically significant. Only 20% of the change was not 
in the direction of project goals. 

The second group — grades 8, 9, and 10 — were given the 
Watson-Glaser Critical Thinking Appraisal , and eighteen null 
hypotheses were tested, with nine of the eighteen attaining 
statistical significance. Sixteen of the eighteen changes 
were in the correct direction. As with the S.S.I.T. group, 
we must conclude that there was change and at least half of 
the change was statistically significant. 

The second hypotheses dealt with changes in attitudes toward 
the educational philosophy and me+*hodology of the project's cur- 
riculum materials. Specifically, this hypothesis refers to the 
four following statements which have been excerpted directly 
from the introductory pages of. Economics Education: A Guide For 
New York Schools : 
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!• ... the teacher must plan» Planning for student learn- 
ing' is the central purpose of the tea<:her. This planning 
involves defining goals and outlining strategies for 
student attainment of those goals. 

2. . « . our public schools should concentrate more on how to 
learn and less on memorizing facts. 

3. .students should spend less time storing information about 
man's history and more time exploring the conditions of 
the present and speculating about the future. 

4. ... developing skills of how to learn should revolve 
around the use of models of inquiry. Learning cannot be 
a helter-skelter process. Learning results from seeing 
problems / asking questions and then seeking solutions 

or answer^ through the process of inquiry. 

In order to evaluate changes in teacher attitudes related to 
the above philosophy/ items from the Semantic Differential Inven- 
tory administered to the classroom teachers, known here as the 
participating teachers, were selected and analyzed. Twelve items 
from the Inventory were selected. Three of these: Recalling 
FactS/ Studying the Past, and Learning by Listening, were felt 
to be the antithesis of the project's philosophy. A decrease in 
teacher's scores on these three items from the pre-to-post inven- 
tory would be viewed as a positive change in attitude by the pro- 
ject. An increase on the other nine items would be viewed as a 
positi\e change in attitude by the project. Our interest here 
was not in determining the significance of change, but attempting 
to define the trend and direction of change, if any. These 
changes have been graphed and are included in Table 3 of thi 
report. 

To summarize the findings, in 10 of the 12 attitude areas 
the participating teachers did move in a direction that the pro- 
ject staff feels indicates increased support for the philosophy 
of the guide^by the teachers. In the first tKree items, teachers 
scored lower on the post inventory than on the pre inventory. 
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In the nine positive items, teachers showed a more positive atti- 
tude on the post inventory than on the pre inventory in every case 
except thos.^ cealxi.q with Behavioral Objectives and Planning for 
Student I.eai ning. 

The third hypothesis dealt with a comparison of attitude 
changes l)e.tween the participating teachers and teachers in the 
region with whom the project had not worked during the year, but 
who had received project curriculum materials. This second group 
also completed the Semantic Differential Inventory on a pre-post 
basis. The comparison of attitudes between these two groups is 
shown in Table 4, 

Using the same selected items as were used for the second 
hypothesis, the project found that with both the negative and 
positive attitude changes the participating teachers showed 
greater change in 9 of the 12 items. The non-participating 
teachers showed greater gain in attitudes toward Learning By 
Listeni ng , Behavioral Ob j ec tives , and P lanning for Student Learn- 
ing. As with the previous hypothesis about teacher attitudes* 
the project was attempting to determine trends and not signif- 
icant changes. Of the 45 non-participating classroom teachers 
pre-tested in October, only 23 returned the post-inventory in 
May. 

Hypothesis four dealt with dissemination of the curriculum 
materials to the third group of teachers. This dissemination 
through demonstrations was followed by a questionnaire to a 
sample of 111 of those teachers. Although all returned ques- 
tionnaires indicated that teachers had shared the materials with 
others in their schpol district, only 23 of the questionnaires 
were returned. Therefore, we feel there is insufficient data 
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upon which to accept or reject this hypothesis. 

Hypothesis five dealt with the dissemination of curriculum 
materials to r.d.viduals and agencies in education statewide 
and nationally. As with the previous hypothesis, the returning 
questionnaires v/ere insufficient for the project to draw a con- 
elusion. Of <.0 questionnaires sent out in April, only nine were 
returned • 

For the ..ixth hypothesis, the project analyzed and compared 
'two additional areas from the Semantic Differential Inventory 
given to the participating teachers. Here the project compared 
teacher attitudes as rated in the following two topics: 

1. Describe This Economics Inservice Course* 

2. Describe Inservice Courses. 

In analyzing the data, the project found that on the pre- 
test the participating teachers rated "Inservice Courses" higher 
than they did "This Economics Inservice Course." With the high- 
est possible average score being 42 points^ the teachers rated 
"Inservic? Courses" at 32.29, and "This Economics Inservice Course** 
at 29,16. On the post-test, the participating teachers rated 
"Inservice Courses" slightly lower at 31.87. At the same time^ 
they rated "This Economics Inservice Course" at an average of 
35.13 poirts. The average point change on "This Economics 
Inservice Course" from pre-*to-post test was 5.97. When compar- 
ing the pre and post-test scores between these two items we 
find that, while on the pre-test "This Economics Inservice Course" 
ranked an average of 3.13 points lower. On the post-test it 
ranked an average of 3.26 points higher. The net average gain 
for "This Economics^ Inservice Course" between pre-test and post- 
test over "Inservice Courses" was 6.39 points. 
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Using these scores and written evaluations, the project 
rejects the sixth hypothesis because we believe tha t teachers 
found this onomics inservice course to be of much greater 
value than other courses in which they have participated. 

Evidc'nce for the final hypothesis can be found in the fact 
that the project staff did develop a revised curriculum guide 
based upon evidence collected during the 1969-70 school year. 
,The resultant product from that collected evidence is entitled. 
Economics Education: A Guide For New York Schools. 
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RECOMMENDATIONS AND ^IMPLICATIONS 

The curriculu:r guide. Economics Education; A Guide For New 
York Schools , should continue to be revised and developed. 
This three-year s tudy presents strong evidence that the 
discipline of economics offers an excellent vehicle through 
which student critical thinking skills can be developed while, 
at the same t i ne , improving the economic literacy of both 
students and teachers. Yet/ this same evidence makes it 
clear that three years is an insufficient amount of time to 
complete such research and experimentation. This project 
was able to develop two editions of these economics mater- 
ials, an original edition and one revision. As a practical 
matter, these materials should undergo at least two more 
revisions ♦ 

The finding of this project should be made available to the 
Curriculum Bureau of the New York State Education Department 
and the Joint Council for Economic Education. Prior to the 
project's final analysis of its data, the staff made several 
contacts, both written and in person, with both of these 
agencies. Much to our disappointment/ neither agency would 
provide our project with any of their reactions or evaluations. 
Now that a final analysis of the data has been made, our pro- 
ject staff believes these agencies should be made aware of 
the implications for future research and development. 

One of the most difficult, yet crucial activities of this 
project has been to develop and maintain local teacher and 
administrator support for the experimental efforts of the 
project. The lapse of time that occurred between the 
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project's study, "An Inventory of the Needs of Teachers 
of Economi cs in the Cat ski 11 Area Schools " in 1967 and now , 
makes it jxtremely difficult to maintain a feeling of owner- 
ship on the part of the educators whom the project is 
attempting to serve. The task here seems to be a need to 
build a deqree of local school involvement while still main- 
taining soiTie project independence. In this way, the project 
can explore and incorporate new ideas in education, while, 
at the same time, involving local school personnel in the 
product development process. 

Future curriculum development and experimentation projects 
of this nature need to be very cognizant of the educational 
philosophies of the teachers with whom it plans to work- 
Although the statistical data provides no direct evidence, 
this project found that teachers' educational philosophies 
were a crucial variable in implementing the curriculum 
materials. In several instances, the teachers found it 
difficult to modify their planning and classroom strategies 
in a way that would make them more compatible with the phil- 
osophy inherent in the project's curriculum materials. On 
the other hand, teachers who had, prior to our project, 
adopted an educational philosophy similar to that of our 
materials, found th^ materials easier to use and actually 
provided them with a viable alternative model for planning 
and car r yi ng out classroom experiences* 

Although this project carried on extensi^^?'^ inservice support 
activities for teachers using the experimental curriculum 
materials, future replication of this work should consider 
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some modifications. This project assumed/ for example, 
that experienced classroom teachers had a working knowledge 
of and skill in using the inquiry process as a mode of learn- 
ing. That turned out to be a false assumption that was not 
uncovered until actual curriculum implementation had begun. 
In the future, implementation and experimentation efforts 
should be preceded by a two or three week workshop in which 
the participating teachers explore the philosophical under- 
pinnings of the project and gain skill and confidence in 
using the planned materials* 



Finally/ there may be long-range affects on student critical 
thinking skills that this project has not been able to 
measure. In contrast with lower levels of cognition, the 
development of higher levels of critical thinking skills is 
a long-range developmental process. These latter skills are 
developed and refined only as the student experiences success 
with them. The implications for this are that the strength 
of student critical thinking skills may become more obvious 
after two or more years of exploration and reinforcement. 
The limited time factor of this study did not permit this 
project to make an evaluation of these gains over such an 
extended period of time. 
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APPENDIX A 

Experimental Graduate Course 
Innovations in Teaching Economics 



Economi cs Education: A Graduate Course 



Economics Education-274 3-4 semester hours 



Innovation in Teaching Economics 

Course Content 

A year long study of economics education in the elementary 
and secondary school classroom by working with an experimental 
curriculum. Students will examine and implement curriculum de- 
veloped at the State University College at Oneonta and demonstrate 
the degree of effectiveness of this and supporting methods and 
materials. Emphasis will be placed on economic education in 
rural life where applicable and how these principles may be de- 
veloped in the classroom. Curriculum materials produced through- 
out the nation will be examined and used with classes when appro- 
priate. Students are expected to be full-time classroom teachers 
and will be admitted to the course only by permission of the 
instructor and the Chairman of the Economics Department. All 
course requirements can be met by students in their own school 
buildings with the exception of two workshops on the college 
campus during the year. The course will carry three semester 
hours of credit with a fourrh hour available to students comple- 
ting an additional project that is approved by the instructor 
and student jointly. 

Course requirements ; 

1. Participation in three workshops; 

a. One three-hour meeting at the beginning of the year 
on the college campus or at the teacher's school at 
whi ch time the experimental curr iculum , Economic 
Education ; A Guide for Rural New York Schools » 
will be introduced and the direction of the course 
will be defined along with course requirements and 
required readings. 

b. Two six-hour meetings at the college during January 
and June in which all teachers participate. These 
meetings will include discussions of progress ex** 
perienced at that stage, future direction of course, 
and final evaluation of the course and the experi- 
mental curriculum . 

2. Classroom teachers will meet at least one hour each 
month from September-June with the instructor concern- 
ing implementation of the curriculum and to discuss the 
progress of the classroom teacher in the course. 
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3. Classroom teachers will attempt implementation of and 
innovation with curriculum guide^ and supportive mater* 
ials supplied by the instructor* ' 

T 

4i 4. Classroom teachers will complete a project connected 

with economic education at the teachers' grade assign- 
ment. This could include video taped lessons, prep- 
aration of bibl'tl^graphies about local economic studies, 
etc. This applies only to people taking the course for 4 hrs. 

5. Classroom teachers will complete pre and post tests 
and questionnaires in economic knowledge and attitudes. 

6. Classroom teachers will administer pre and post tests 
and questionnaires to their classes as supplied by the 
instructor . 

Prerequisites : 

1. Full-time classroom teacher in grades kindergar ten-11 . 

2. Permission of instructor and Economics Department Chair- 
man . 



3. Approval from the administration of the teacher's school 

to permit the kind of ins tructor- teacher contact described 
herein. 



( ^ 

Course credit - 

1. Class may be taken for undergraduate or graduate credit 
in Economi cs through SUCO . 

2. Class may be taken for in-service credit, and upon suc- 
cessful completion of course requirements. Project PROBE 
will recommend to the teacher's administration that 
salary credit be given, if that is that school district's 
policy . 



Goals for the course: 



1, To provide close and continued suppor t of classroom 

teachers to assist them in improving their teaching of 
economics at their assigned grade level by conducting 
workshops at the classroom teacher's school and on the 
college campus, and by regular monthly conferences be- 
tween the classroom teacher and the instructor. 




To demonstrate operative methods of presenting concepts 
and principles of economics at all grade levels by pro- 
viding a curriculum guide in economics that defines be- 
havioral objectives, content, teaching strategies. 



evaluation techniques, and appropriate supportive mater- 
ials. 

3. To demonstrate operative aiethods of presenting concepts 
and principles of economics at all grade levels by demon- 
stration lessons, holding workshops, and individual con- 
ferences in which these experiences will represent the 
main focus of attention. 

4. To provide, through the Economics Department's Specialist 
in Economic Education, the guidance in the identification 
of methods to implement the economics content recommen- 
dations of the New York State Syllabus* Guides in Kin*- 
dergar ten -Grade 11. 

5. To assist classroom teachers in the identification and 
use of local, state, and national sources of material 
for supporting classroom strategies by obtaining preview 
copies of materials, evaluating materials, and dissem- 
inating this information • 

6. To evaluate classroom teacher's attitudes concerning 

the viabili ty and quality of a Directed Study In-Service 
course conducted in close proximity to the classroom 
environment as evidenced by a questionnaire at the 
close of the course. 



General Objectives : 

Objectives for teachers participating in curriculum evalua- 
tion activi ties during 1970-71 school year • 

Teachers wno have participated in Project PROBERS curriculum 
evaluation activities will: 

1. demonstrate skill in implementing instructional strate- 
gies in economic education as evidenced by observations 
and conferences conducted by the project staff, 

2. demonstrate increased knowledge of economic concepts 
and principles as a result of using Project PROBE ma- 
terials as shown by pre and pest testing using S.R.A. 
Test of Economic Understanding . 

3. demonstrate changes in attitude toward economic values 
as a result of using Project PROBB materials as shown 
by pre and post questionnaire^ using Economic Attitude 
Scale • 

4. demonstrate the ability to plan instructional strategies 
for presentation of economic concepts and principles 
through the development of a media project, written 
unit, or a preplanned and video-taped classroom lesson 

as evidenced in the evaluation of the developed materials 
and teacher-ins true tor conferences . 
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Objectives for students participating in curriculum evalu- 
ation activities during 1970-71 school year. 

Students who have participated in Project PROBE 's curricu- 
lum evaluation activities will: 

1. demonstrate an increased skill in identifying and ap- 
plying economi c concepts and principles as evidenced 
in pre and post tests of curriculum topics to which 
they have been exposed in Economic Education: A Guide 
for Rural New York Schools' ^ observations by the tea- 
chers, and student work - oral and written . 

2. demonstrate the increased skill to synthesize and eval-^ 
uate economic ideas as evidenced by pre and post tests 
of curriculum topics s tudied $ observati on by the tea- 
cher, and student's work - oral and written. 

3. demonstrate an increased awareness of localized eco- 
nomic institutions, organizations, and problems as 
evidenced by pre and post tests of curriculum topics 
studied, and student's work - oral and written. 



The establishment of this course offers advantages to ; 

1. The classroom teacher (as student) ; 

a. professional improvement. 

b. close support of a curriculum specialist in the 
field of economic education^ 

c. opportunity to obtain prepared classroom materials 
designed to be used with the Hew York State Syllabus 
Guides . 

d. opportunity to gain college credit "on-the-job." 

e. classes held in the teacher's school during un- 
scheduled periods or immediately after school for 
limited periods. 

2. The school districts participating: 

a. professional improvement of school staff. 

b. opportunity for cooperation with college staff. 

c. supply of useful classroom materials (some on a 
temporary basis ) without cost. 

d. assistance in improving part of the social studies 
program for students • 

3. The Economics Department and Center for Economic Education: 

a . obtaining teachers that will be more fully commi tted 
to the curriculum evaluation efforts of the Center 
for Economic Education* 

b. obtaining public school classrooms for evaluation 
purposes With respect to our curriculum guide • 



well-defined target population for evaluation efforts 
opportunity to explore the value and application 
of directed study in-service courses and determine 
their future potential as part of the Center for 
Economi c Education. 
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APPENDIX B 
Semantic Differential Inventory 



ERJC 



School Grade Level 



Birthdate Month (in) Day 
Name ^ ...^^ (numbers) ^^^^^^^ 

ATTITUDE INVENTORY 

This scale is a method of measuring what words mean to you. There 
are no right or wrong answers, so simply indicate your first impressions 
or feelings about each word or phrase* 

At the bottom of the page is a completed example of what you will 
be asked to do* Please refer to it as we read these instructions* 

There are seven blanks* The position of each blank can be des<» 
cribed by the term directly above it* 

very Quite Slightly Neutral Slightly Quite Very 

Good ..^^ — — 

At the top of the example is the word "HOMEWORK** * This is not any 
particular homework* Whatever "HOMEWORK" means to you is what you are 
to think about* ^ 

Look at the first word pair: 

Good X_ ^ Bad 

The idea of HOMEWORK was very good to me so I checked the blank 



"Very" 

under 



, substituting in this case the word "Good" for the dash* 



Make each item ^ separate decision . Be sure and put your check 
mark on the line provided* 

Look over the example again to be sure you understand and then go 
on to the rest of the scale* 

EXAMPLE 
Describe! HOMEWORK 
very Quite Slightly jj^^^ral Slightly Quite Very 



Good^ 

Boring^ 

Worthless^ 

Child 
Centered^ 

Harmful^ 

Necessary 



X 



Bad 

^Interesting 

Valuable 

Teacher 
Centered 

Beneficial 

Unnaccssary 



Describe: NEW YORK STATE SYLLABUS GUIDES 

H Very Quite Slightly Slightly Quite Very 

Neutral 



Gooa B«d 

Boring Interesting 

worthless Valuable 

Child Centered ^ . Teacher Centered 

Harmful Beneficial 

Necessary . Unnecessary 



Describe: RECALLING FACTS 

Very Quite Slightly Slightly Quite Very 

Neutral 



Good Bad 

Boring , Interesting 

Worthless valuable 

C ilcl Contertid Teacher Centered 

Harmful Beneficial 

Necessary Unnecessary 

Describe: STUDYING THE PAST 

Very Quite Slightly Slightly Quite Very 

Neutral 



Good Bad 

Boring Interesting 

worthless valuable 

Child centered Teacher Centered 

Harmful Beneficial 

Necessary , unnecessary 



Describe: PROJECT PROBE 

Very Quite Slightly Slightly Quite Very 

Neuttal 



Good Bad 

Boring Interesting 

Worthless Valuable 

Child Centered Teacher Centered 

Harmful Beneficial 

Necessary Unnecessary 



Describe: BEHAVIORAL OBJECTIVES 

Very Quite Slightly Slightly Quite Very 

Neutral 



Good Bad 

Boring Interesting 

Worthless Valuable 

Child Centered Teacher Centered 

Harmful Beneficial 

Necessary «____>_ Unnecessary 



Describe: LEARNING BY LISTENING 

Very Quite Slightly Slightly Quite Very 

Neutral 



Good Bad 

Boring Interesting 

Worthless Valuable 

Child Centered Teacher Centered 

Harmful Beneficial 

Necessary _____ _____ Unnecessary 



Describe: CURRICULUM GUIDES 

Very Quite Slightly Slightly Quite Very 

Neutral 



Good Bad 

Boring Interesting 

Worthless valuable 

Child Centered Teacher Centered 

Harmful Beneficial 

Necessary Unnecessary 



Describe: INSERVICE COURSES 

Very Quite Slightly Slightly Quite Very 

Neutral 



Good Bad 

Boring Interesting 

worthless valuable 



ChUd Centered Teacher Centered 

Harmful Beneficial 

Necessary Unnecessary 



Describe: INDUCTIVE TEACHING 

Very Quite Slightly Slightly Quite Very 

Neutral 



Good Bad 

Boring Interesting 

worthless valuable 

Child Centered Teacher Centered 

Harmful Beneficial 



Describe: PLMINING FOR STDDBNT LEABNXNG 

f Very Quite Slightly Sli^tly Quite Very 

Neutral 



Good ^^^^^^^^^ . . ««« — 

BoJfing . ^ -^--^ — — . Interesting 

Worthless _ — , Valuable 

Child Centered ^^^^^^^^ . . . Teacher Centered 

Harmful ^^^^ .^....^ --.^-.^^ ^^.^^^....^ ... .....^ ^ Beneficial 

Necessary _ . Unnecessary 



Describes INQDIjRSr TB/iCKING 

Very Quite Sli^tly slic^tly Quite Very 

Neutral 



Good . Bad 

Boring ^^^^^ . , . ...^^ — Interesting 

Worthless . Valuable 

Child Centered ^^^^^ - ^......^ , Teacher Centered 

Hatmful ...^.^ — «^ beneficial 

Necessary ^^^^^ bnnecessary 



Describes ROLE PLAYING 

Very Ouite Slightly Slightly Quite Very 

Neutral 



Good B^ 

Boring ^ ' ^_ — , Interesting 

worthless ..^^^ _^ Valuable 

Child Centered — Taaohe^ Cantered 

Harmful ^^^^ ^ — ^ Beneficial 

Necessary Unnecessary 



i 



Describe: PROJECT PPDBE ECONOMICS EDUCATI(»T GUIDE FOR NEW YORK SCHOOLS 

Very Quite Slightly Slightly Quite Very 

Neutral 



Good 
Boring 
Worthless 
Child Centered 
Harmful 
Necesseuy 



Bad 

Interesting 
Valuable 

Teacher Centered 

Beneficial 

Unnecessary 



Describe: LEARNING BY DOING 

Very Quite Slightly Slightly Quite Very 

Neutreil 



Good 
Boring 
Worthless 
Child Centered 
Harmful 
Necessary 



Bad 

Interesting 
Valuable 

Teacher Centered 

Beneficial 

Unnecessaury 



Describe: EVALUATION OF STUDENT LEARNING 

Very Quite Slightly Slightly Quite '^ety 

Neutral 



Good 
Boring 
Worthless 
Child Centered 
Harmful 
Necessary 



Bad 

Interesting 
Valuable 

Teacher Centered 

Beneficial 

Unnecessary 



Describe: STUDYING THE PRESENT 

Very Quite Slightly Slightly Quite Very 

Neutral 



Good Bad 

Boring ______ _ ^ Interesting 

worthless Valuable 

Child Centered 1_ Teacher Centered 

Harmful Beneficial 

Necessary ' Unnecessary 



Describe: PROBLEM SOLVING 

very Quite Slightly Slightly Quite Very 

Neutral 



Good Bad 

Boring Interesting 

Worthless Valuable 

Child Centered Teacher Centered 

Harmful _^ . ^ Beneficial 

Necessary Unnecessary 



Describe: MULTIPLE KBSOUBCE TEACHING 

Very Quite Slightly Slightly Q-»ite Very 

Neutral 



Good Bad 

Boring ___^ Interesting 

Worthless valuable 

Child Centered Teacher Centered 

Harmful Beneficial 

Necessary Unnecessary 



Describe: CASE STUDY APPROACH TO TEACHING 

Very Quite Slightly S lightly Quite Very 

Neutral 



Good _ .^.^^^ _ Bad 

Boring Interesting 

Worthless Valuable 

Child Centered . Teacher Centered 

Harmful Beneficial 

Necessary Unnecessary 



DescribOf STUDYING THE FUTURE 

Very Quite Slightly Slightly Quite Very 

Neutral 



Good ^ Bad 

Boring — . Interesting 

Worthless Valuable 

Child Centered ^ Teacher Centered 

Harmful Beneficial 

Necessary — — ^— — — — - Unnecessary 



Describe; THIS ECONOMICS INSERVICE COURSE 

Very Quite Slightly Slightly Quite V^ry 

Neutral 



Good Bad 

Boiing _ Interesting 

Worthless Valuable 

Child Centered _____ — ^ Teacher Centered 

Harmful Beneficial 

Necessary ^ - — — — — Unnecessary 
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APPENDIX C 
Survey Questionnaire 



QUESTIONNAIRE ; Please Return By May 1, 1971 



Directions : The questionnaire is concerned with curriculum materials 
entitled, Economic Education; A Guide for New York Schools # A copy 
of that guide was forwarded to you last Fall. If you still retain 
that guide , please answer the questions below . If you have forwarded 
the guide to someone else in your institution, please pass this ques* 
tionnaire along to that person so they can respond to these questions. 



Position or Title of Respondent 

Institution or Agency where employed 



Please circle or underline the most appropriate response for each of 
the following; 

1. Since receiving the materials, Economic Education: A Guide for 
New York Schools , I have reviewed them : 

Extensively Moderately Not at all 



2. Since receiving the materials, I have shared and discussed them 
with; 

Several people 1 or 2 persons No one 

Please indicate with whom you have shared, i.e. elementary or 
secondary teachers, department chairman, curriculum coordinators, 
students , etc . ; 



3. Since receiving the materials, I have used them in my classes: 

Extensively Moderately Not at all Not applicable 



4« If used in classes, what grade level (s) 



5« Havinj reviewed the materials, I have concluded that it would be 
most beneficial to education to : 

Continue to revise and develop these materials 
Discard these materials as useless 



Other 



The following are open-ended questions. We would like to have you 
react to each with several sentences that summarize your opinion 
or evaluation of the materials if you have reviewed or used them. 



6. In my opinion, the behavioral objectives^ as structured and 
presented in these materials are: 



?• In my opinion, the emphasis this guide places on the development 
of critical thinking skills is: 



8. If this guide is to be revised in the near future, I would recom*- 
mend that the following weaknesses in the guide materials should 
receive priority consideration because: 

A* 



Project PROBE 
127 Old Main 

State University College 
Oneonta, New York 13820 



APPENDIX D 
Test Methodology 



't" Test Methodology 



a. t Value 



^ _ pre post 



b. Standard Error of the Difference Between. Means 



:. Standard Error of the Mean 



d. Mean e. Standard Deviation 



N 



f. Pearson's Product-Moment Correlation Coefficient 

N^XY - (IX) (^Y) 
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APPENDIX E 
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Name 
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Grade Date 



Explanation to Students s 



This booklet has some stories . After each story 
there are some sentences about the story. First, I 
will read the story out loud to you and you can follow 
along in your booklet. Then I will read each of the 
sentences and you are to decide whether tho sentence 
is probably true, probably false, or if you can't tell 
from the story whether the sentence is probably true 
or probably false. 



Decide on an answer for each sentence that I read 
to you. Mark your answer with a heavy black mark* If 
you think the answer is probably true, mark in the space 
under "Probably True.'* If you think the answer is prob- 
ably false, mark in the space under "Probably False." 
If you can't tell from the story whether the sentence is 
probably true or probably false, mark in the space under 
"Can't Tell." 



Some of the sentences arc "Probably True" and some 
of the sentences are "Probably False." You can't tell 
if some of them are true or false. 



Example : 

Mr. Jones was a farmer in the midwest. When he 
heard about the discovery of gold in California 
he left his family and went to California. 

1. Mr. Jones went with his family to California. 

2. Mr. Jones went to California because he did 
not like the place in which he lived • 



2. 



Martha left her school friends and moved with her family to 
America. Soon after she got to America she started to school* On 
her first day at school the other children looked at Martha and 
talked about her. She did not speak to other children, and at 
recess she sat alone and watched them play. She told the teacher 
that she was unhappy. When she got home from school she cried. 



Probably Can't Probably 

True Tell False 

1. Martha wanted to play with the 

other children. 

2. Martha will make friends at 

this school. , ^ 

3. Martha speaks English. 

4. Martha will teach the children 

how to play some new games. 

5. Martha stayed home from school 

the next day. 

6. The teacher likes Martha. ^ 

******************** 

Mr. Edwards* farm was in the valley. He had just finished 

planting his seeds. He could see the snow on the mountains. He 

hoped the snows would not melt too fast. The fire last summer 
burned most of the trees on the mountainside. 

Probably Can't Probably 
True Tell False 

7. More water will flow into the 

valley this year than last. ^ 

8. Mr. Edwards' seeds will die of 

frost. , 

9. Topsoil from the mountain will 

be washed down into the valley. 

10. Mr. Edwards planted his seeds 

after the snow fell. . 

11. Mr. Edwards will have enough water 

for his farm this year. 

12. Mr. Edwards' farm is on the 

mountainside. ^ 

******************** 

Mr. and Mrs. Koski remembered the day they docked in New York • 
They had been married only two months when they arrived from Poland. 
America was a strange land to them. Mr. Koski worked hard for many 
years so his children could go to school. Ed, the oldest child# 
is now in college and will one day become a lawyer. 

Probably Can • t Probably 

True Tell False 

The Koskis spoke English when 

they first came to America. 

The Koskis came to America last year. 

Ed is proud of his father. 

The Koskis will return to Poland 

to live. ' 




******************** 
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14. 
15. 
16. 



3. 



Pambo is twelve years old. There are no schools where Pambo 
lives* He does not read or write. He fishes with his father 
every day. Pambo is learning to cut wood from tree bark in order 
to make a canoe. His father teaches him many things and is, proud 
of how well Pambo can do them. 

Tom is also twelve years old. He works hard at school and 
gets good grades. When he comes home from school he reads his 
books so that he will learn things that will help him. 

Probably Can' t Probably 
True Tell False 

17. Tom is smarter than Pambo. 

18. Pambo*s father can read and write. 

19. Pambo is having trouble learning 

how to make canoes. .....J^ 

Pambo and his family are going to move to the city where Tom livec 

20. Pambo will go fishing every day, 

with his father. 

21. Pambo will teach Tom how to make 

canoes. 

22. Tom reads every day because he 

is behind in his school work. 

******************** 

Henry's father is a farmer. Henry is twelve years old. During 
the week Henry goes to school and he wants to become a teacher. On 
W'eekends he works on the farm and has learned to drive a tractor. 
His father is happy that Henry wants to become a teacher. 

Taro is also twelve years old. Taro*s father is a hunter. 
Taro's grandfather also was a hunter. Taro is learning to hunt 
from his father. Many times on the way home from hunting Taro 
stops to watch the fisherman. One day Taro asked his father, '*Can 
I become a fisherman?'* Taro*s father said, **No, because I am a 
hunter." 

Probably Can't Probably 
True Tell False 

23. Henry will become a teacher. — 

24. Henry's father wants Henry to 

become a farmer. 

25. Henry's grandfather was a 

farmer. — — _ 

26. Taro will leave the tribe and 

become a fisherman. ' 

27. Taro's sons probably will 

become hunters . ......^ 

******************** 



4. 



Three months -after the Picker had been invented more f lander 
had been picked than for all of the year before. All of the 
1^, machines at the textile mills were working day and night. Six 

months after the Picker had been put to use the mills realized 
that they could not process the amount of flander sent to them. 

Probably Can't Probably 
True Tell False 

Flander is a type of cotton. > 

The Picker will be used only three 

months each year. . 

Flander is one of the most impor- 
tant products of this country. 

Flander is used in making cloth. 

The mills will change the way 

they process flander. 

Less flander will be grown next 

year. 

The price of materials made of 

flander will go down. 

******************** 

Mr. Harvey spoke to the Founders Club last night. Here is 
part of what he said: 

"In the early days of our country many people settled 
here from other countries. They came here to establish 
a way of life that was better than they had in their own 
countries. They helped build a strong America because 
they believed in America . Today the foreigners who come 
here do not seem to appreciate the freedom and opportunity 
America offers them. We ought to be more careful about 
who we let in and require an oath of these foreigners 
before we accept them. '* 

Probably Can't Probably 
True Tell False 

Mr. Harvey feels that people who 

take an oath can be trusted. 

Mr. Harvey is against more people 

coming to America from other lands. 

Mr . Harvey believes the early 

settlers were good for America. 

Mr. Harvey has studied a great deal 

about America. 

Mr . Harvey believes that people 
born in .America are more, loyal than 

people coming from other lands . ... _ 

Mr. Harvey believes that there are 

too many foreigners in America now. 

Mr. Harvey's grandfather was 

probably born in America. 

Mr. Harvey is running for political 

office. 

******************** 
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26. 
29. 

30. 

31. 
32. 

33. 

34. 



35. 
36. 
37. 
38. 
39. 

40. 
41. 
42. 



Thirty years ago Mr . Rand bought a thousand acres of farmland . 
Many new industries have developed in the city nearby. About ten 
years ago Mr. Rand sold half his farmland to people who build homes. 
Last year Mr. Rand sold two hundred acres more and many hemes have 
already been built on this land. 

Probably Can't Probably 
True Tell False 

43. The people are coming to work on 

Mr . Rand ' s farm. 

44. They are building houses for the 
people coming to work in the 

industries. 

45. Mr. Rand will sell the rest of his 
farmland to the people building 

homes ^ 

46. Mr. Rand still owns half of the 
farmland that he bought thirty 

years ago. 

47. Next year there will be more 

people working in industry, 

48. Mr. Rand sold his farmland for 

more money than he paid for it, 

49. They will need more schools. 

50. The people who had worked on Mr. 

Rand's farm went to work for industry. 

51. The people who ^bought Mr. Rand's 

farmland were farmers. 

******************** 

People A: 

The vote had been very close. A number of the representatives 
did not like the outcome. They decided to go back to their districts 
and appeal to the people for support. This was the fourth important 
issue on which the Presid'ent had been defeated. 

People B: 

The Chief asked his council for advice and then he told his 
people what he had decided. The people listened to their Chief. 
When he was through talking they cheered. 

Probably Can ' t Probably 
True Tell False 

52. People A and People B have the 

same system of government. 

53. The representatives of People A 

are selected by the President. 

54. People A will re-elect the repre- 
sentatives who voted for the bills 

the Prejident supported. 

55. People B vote on what the Chief 

wants to do. ^ 

56. The Chief of People B knew his 

people would do what he says. 

57. Most of the representatives of Peo- 
ple A agreed on the issue that they 

had just voted on. 

58. People B vote for the members of 

the council. ^ 



******************** 
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Mr. Jones owns a grocery store. Often, in the last few weeks, 
he has not had enough bread for his customers. It has been an 
unusually dry season in the area and the wheat crop has not done 
well this year. 

Probably Can*t Probably 
True Tell False 

59. The delivery trucks have broken 
down so Mr. Jones is unable to 

get bread. _ , 

60. There was as much rainfall this 

year as last year . 

61. The bakers have been very busy 

this year. 

62. Mr. Jones will start baking his 

own bread. , - 

63. They are using the wheat to make 
other things this year rather 

than for making bread. — 

64. Mr. Jones will close his store 

until more bread is baked. 

65. The wheat crop was of poor 

quality. 

66. The price of bread is higher 

this year than last year. 

67. Mr. Jones will make less money 

this year than last year. 

68. More wheat will be harvested 

this year than last. ^ 
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DISSEMINATION OF CURRICULUM GUIDE 



The guide, Economics Education; A Guide For New York 
Schools ; has s ince be on disseminated extensively to teachers , 
cidministra tors , curriculum people, and economics educational 
specialis^ts at the local", state, and national levels. The list 
below summarizes the project's dissemination efforts: 

1. Copies to all principals, supervisors, curriculum 
specialists, and secondary social studies teachers in 
the 47 school districts within the project's region. 

2. Copies to all elementary teachers in the project region 
who previously used other project materials - about 100 
teachers . 

3. Copies to 450 teachers and student teachers in 65 
school districts of upstate New York. These were dis- 
tributed following demonstrations set up through the 
Student Teaching Office at the State University College 
at Oneon ta . 

4. Copies to 97 Councils and Centers of Economics Education 
and Research located in all 50 states • 

5. Copies to all 25 supervisors of elementary and secondary 
social studies student teachers at the State University 
College at Oneonta. 

6. Copies to members of the New York State Education 
Department - Bureaus of Elementary and Secondary Social 
Studies Education. 

7. The guide has been microfiched, cataloged, and made 
available nationally by the ERIC-ChESS Social Studies 
Consortium, Boulder, Colorado, An abstract of the guide 
first appeared in the January, 1971, catalog supplement 
entitled, "Keeping Up," a monthly newsletter from ERIC- 
ChESS. 

8. Requests since publication have been received from 35 
educational agencies in nine states* All these requests 
have been honored. 

In all, the project printed; • 

1. 800 copies of the guide for elementary grades K-6. 

2. 400 copies of the guide for secondary grades 7-11, 

3. 175 copies of the guide for elementary and secondary 
grades K-11. 

4. 25 copies of the guide for elementary and secondary 
grades were left unbound for distribution by grade level 
to student teachers . 



Of these 1400 printed copitts# the project still has on 

hand : 

1* 152 copies for elementary grades K-6» 

2. 66 copies for secondary grades 7-11. 

3. 62 copies for elementary and secondary grades K-11* 

4. Various quantities of unbound grade levels* 

These remaining copies will be turned over to the Center 
for Economics "EHlic^ation and Research at the State University 
College at Oneonta, That Center will continue to pursue the 
activities begun by this project* 
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TEACHERS PARTICIPATING IN THE 
CURRICULUM EXPERIMENTATION PROJECT 



The prorect wishes to acknowledge the extensive contrib- 
utions made by the 35 teachers in four school districts. These 
teachers labored diligently during the 1970--71 school year with 
the revised curriculum materials published by this project. 

GREENE CENTRAL SCHO OL 

Alice Salisbury 
Claire Anne Ni elsen 
Adrienne Si Iverna il 
Ann Morey 
Geneva Kraus 
Sandra Utter 
Jeanne Marshman 
Marka Welsh 
Joan Allis 
Gretchen Sperling 
Deborah Sweet 
Susan English 
Rochelle Weiner 



LAURENS CENTRAL SCHOOL 

Anna May Church 
Ruth Bliss 



SIDNEY JUNIOR-SENIOR HIGH SCHOOL 

Lorraine Zimniewicz 
Richard Lewis 
John Gallagher 
Irma Haller 
Douglas Quinney 
James Warren 



ONEONTA JUNIOR HIGH SCHOOL 



Steve McMullen 
Rodney Auwa ter 
Audrey Cooper 
Joanne Yacono 
Lorraine Has hey 
Edwin Gibson 
Mary Jane Durkee 
Claucine Evans 
Richard Howell 
Diana Howell 
Wi 1 liam Rabe 
Robert Shevlin 
Randolph Geraghty 



Be mice Gonser 



